Connections Between ICA and Sparse Coding Revisited
نویسندگان
چکیده
Recently, the application of Independent Component Analysis (ICA) to natural images has raised a great interest. Some outstanding features have been observed, like the sparse distribution of the independent components and the special appearance of the ICA bases (most of them look like edges). This paper provides a new insight on this behaviour, being supported by experimental results. In particular, a mathematical proof of the relation between ICA and sparse coding is given.
منابع مشابه
ICA with Sparse Connections: Revisited
When applying independent component analysis (ICA), sometimes we expect the connections between the observed mixtures and the recovered independent components (or the original sources) to be sparse, to make the interpretation easier or to reduce the random effect in the results. In this paper we propose two methods to tackle this problem. One is based on adaptive Lasso, which exploits the L1 pe...
متن کاملLocal Linear Independent Component Analysis Based on Clustering
In standard Independent Component Analysis (ICA), a linear data model is used for a global description of the data. Even though linear ICA yields meaningful results in many cases, it can provide a crude approximation only for general nonlinear data distributions. In this paper a new structure is proposed, where local ICA models are used in connection with a suitable grouping algorithm clusterin...
متن کاملICA with Sparse Connections
When applying independent component analysis (ICA), sometimes we expect that the connections between the observed mixtures and the recovered independent components (or the original sources) to be sparse, to make the interpretation easier or to reduce the model complexity. In this paper we propose natural gradient algorithms for ICA with a sparse separation matrix, as well as ICA with a sparse m...
متن کاملFace Recognition using an Affine Sparse Coding approach
Sparse coding is an unsupervised method which learns a set of over-complete bases to represent data such as image and video. Sparse coding has increasing attraction for image classification applications in recent years. But in the cases where we have some similar images from different classes, such as face recognition applications, different images may be classified into the same class, and hen...
متن کاملICA with Reconstruction Cost for Efficient Overcomplete Feature Learning
Independent Components Analysis (ICA) and its variants have been successfully used for unsupervised feature learning. However, standard ICA requires an orthonoramlity constraint to be enforced, which makes it difficult to learn overcomplete features. In addition, ICA is sensitive to whitening. These properties make it challenging to scale ICA to high dimensional data. In this paper, we propose ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2005